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ABSTRACT j } 

\ Colleges and universities in California may be 

accredited or approved by four different agencies to ofi-fer approved 
programs of teacher education: the State Department of Education's 
Office of Private Postsecondary Education (OPPE) (tor private 
institutions); the Western Association of Schools and Colleges 
(NASC); the Commission on Teacher Credentialing (CTC);. and, 
optionally, the National Council for Accreditation of Tea'cher 
Education ( NCATE ) . This paper attempts to identify overlaps and taps 
jn the accreditation/evaluation processes, and presents y 
, recommendations for the redesign of* the CTC. All 11 the agencies use 
team visits. In addition, all but the CTC use self-studies. Standards 
appear to be the major difference between the agencies* approaches. 
OPPE and NASC concentrate on facilities, institutional support, 
faculty, and in a general manner, program content . NCATE* s standards 
overlap CTC's guidelines in several area's' of curriculum. The results 
of the comparison indicate that Some combination of a self-study- and 
candidate-centered evaluation, with more rigor in the initial 
approval process, is necessary to achieve more efficiency and 
effectiveness in the CTC evaluation process. (BW) 
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EVALUATION PROCESSES OF REGIONAL AND, 
NATIONAL EDUCATION ACCREDITING AGENCIES^ 

Implications, for Redesigning an 
? Evaluation Process in California 



. BACKGROUND 

h 

.Colleges and Universities in California must be accredited or approved by at / 

least three agencies to offer approved programs of teacher education. Private 

institutions must first have the approval of the State Department of Education'^ .' 

Office of Private Postsecondary Education (OPPE) to offer degree programs. Public 

institutions must be authorized by their respective California State University » 

and University of California systems. .Second, institutions must be accredited ' /% 

by the Western Association of Schools and'Colreges (WASC). Then, institutions 

must submit a document that states that ttie program is'in* compliance, with all CTC 

f * ■ . * 

guidelines in order to gain the approval of the Commission on Teacher Crederttialing 

(ctc). • - 
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Evaluation of -these programs is conducted at approximately six year intervals, 
and teacher' education programs that are initially approved can operate" un inter- 
ruptedly until the CTC evaluation teams' visit the campus. If compliance is 
determined by the evaluation team, the institution can continue to operate for 
another, five years. If aspects of the program fail to comply with existing 
criteria, the institution must terminate that program v or. remedy deficiencies 
within one year to avoid termination. In addition to OPPE, WASC, 'a,nd,CTC 
accreditation* educational institutions often choose t&be accredited- by the 

...... 

National Council for Accreditation of teacher Edition (NCATE). \\ 



Redesigning the CTC Evaluation Process 



• 'V. 

■ « 



Recognizing \that teacher education programs are revi ftffi^&t^l eas$ threat and 
perhaps four agencies that rely to some extent on e*ch v other, this paper attenpts 
to identify overlaps and gaps 1n the accreditation/evaluation processes. Further, 

. • . ,.' ••• 3 ■ ?/' ■ 



it presents recdnsriendati ons for the redesign efforts of the CTC that will 
result in a process' that is more efficient and effective* 



0 
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There are three major areas of the current CTC evaluation process which are 

■ ,* 

being addressed in the redesign effort; and in addition, one constraint has 

been added to the. redesign. 

JL. The current process is too expensive to operate under current funding 
provisions. ^ 

The CTC must pay for evaluation team visits to approximately 90 
programs per year. Three members are assigned to each program for 
three days. Several staff members must be used continuously 
. throughout the year. These' evaluations are the biggest budget Item 

„ of the CTC, costing approximately $800,000 per year. In the past, *. 
this was not a. major problem since the CTC. is funded totally from 
credential fees paid by applicants. During the past year, however, 
the number of credentials issued has dropped by around 30% with 
directly proportional, loss of fees and the trend is expected to 

' continue during the inroediate future. y 

, • Y . " r 

2. The current process is not time efficient . , r 

The CTC's basic evaluation charge from the California Legislature is 
to ensure that the standards established by the state have been 
implemented in California teacher education programs.' There 'are 
almost 700 programs in 70 institutions in California to evaluate. 
Approximately 401 of the programs currently in operation have never 
been evaluated by the CTC. The initial evaluation process used by 
the CTC commenced in 1976, and from 1976 to 1981 only a few programs 
at selected institutions were evaluated. Starting in 1982, all 

i programs at each institution scheduled for evaluation were evaluated. 

, With the current process; it will take four andn^ne-half years to 

complete evaluations of all the programs that- have not at this time 
been evaluated. » 

3. The current process is effective for assessing compliance^ut not 
effective in assessing quality . * 

• , , * 

The CTC guidelines that institutions use to set up programs, and 
which is used by evaluation team members to evaluate programs, are 
written in a compliance mode. The e valuators who are directed to 
make assessments of the effectiveness of the programs are volunteers 
,of differing backgrounds with* different work ethics and ideas. This- 
leads to many inconsistent judgments o.f effectiveness. 

4. New Legislation has been introduced that will constrain the CTC to 
use a candidate-centered evaluation process . 

The current process 1s geared, for program- centered evaluation. 
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SUMMARY AND RECOMMENDATION^ 

As the table/on the next eight pages shows, the agencies that accredit 
teacher education programs, or institutions, in California utilize the 
^| "team visit" technique'* The three accrediting agencies (other than the CTC) 
use self-studies in addition to the team visit. * 

• ■ * 

i There are many strengths and weaknesses inherent with the team approach, and 
representatives from each agency have identified these as listed at tha end 
of the attached table. Standards appear to be the major difference between ' 
the agencies' approaches. OPPE and WASC concentrate on facilities, institutional 

• » 

support, faculty, and in a general manner, program content. It is important 
to note that NCATE's standards overlap CTC's guidelines in several areas o'f 
curriculum/ 
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In all the accreditation processes other than CTC's, reviews take place in time 

r 

spans no greater than five years; the institutions pay for the team visits. • 
NCATE has the. only process that is optional. ATI processes provide some sort of 
training for the team members. * . 

* 

Recommendations 

The current CTC process is effective in identifying non-compliant teacher, education 

programs, in a highly professional, rigorous approach. The costs and the • * * 

logistics of the current CTC evaluation process, however, inhibit tbe evaluation 

of teacher education programs that have as yet not been evaluated by the CTC. 

« 

From^this Study of the accrediting processes used by National' and Regional 

\ * * * ~ ' 

Accreditation Agencies which evaluate California teacher education programs, the 

* 

following recommendations have ireeto submitted: 

1 



1. CTC' should develop new guidelines which are clear, precise and 
quantifiable. ^ 

2. The CTC evaluation process should not put emphasis on facilities and 
faculty since the accreditation processes do so. 'Results of past 
evaluations in California have shown that strong faculty leadership 
always accompanies successful programs; for this reas^ft some standard 
criteria for evaluating leadership would be appropriate. 

4 * 

3. The backlog of program. evaluations in California, and the success of 
the use of the self-study oreintation by Accrediting*Agencies is such* 
that self-studies should be used effectively to determine areas where 
immediate formal, evaluation is necessary. * 

4. With a more rigorous initial approval process, teacher education programs 
can be assessed and direction extended early in their development. 

5. The candidate-centered evaluation approach recently enjoined by the ' 
California Legislature may be a technique that proves effective in . 
avoiding overlaps with the three Accreditation Agencies. Also, the 
.candidate-centered approach may provide a method for gathering data* ~ 
from the programs on a regular basis or a way to use existing data oh 
this regular basis. There may also be some benefit occurring "from use 
by CTC of aji approach differing from that used by the Accreditation 
Agencies since- complenjBntary data may be obtained. 

6. Until CTC has evaluated all teacher education programs once, it will * 
probably be desirable to rely on NCATE accreditation results. 

CONCLUSION 

The results of this study show that som£ combination of a self-study and 
candidate-centered evaluation, with more rigor in the initial approval process, 

are necessary to achieve more efficiency and effectiveness in the CTC evaluation 

■ • » 
process. . 



Greater rigor in the irtitial approval process will assure the CTC that new programs 
are appropriately developed, that the programs will be implemented in a compliant 
fashion, or redirected as necessary, and will also assure the CTC that the content 
of all teacher education programs are reviewed before it is tried with candidates; 



A synthesis" of the self-study and candidate-centered processes will add 

* 

greater rigor to the evaluation process and the data produced through, these" 
methods will serve as indicators of quality programs without the expense and/or 
complicated logistics associated with the team visits. The thoroughness of 
these data, however, could point to prob.lems with programs that may warrant 
* staff or evaluation team visits. ^ 

The recommendations of this study will be considered al'ong with the recommenda- 
tions that evolve out of the study of evaluation processes used by professions 
other than education and the study of processes used in other states. The 
redesign of the CTC evaluation process will be completed by March 1985. 
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EVALUATION PROCESSES OP AGENCIES THAT ACCREDITS VbACHEH EDUCATION PROGRAMS IN CALIFORNIA 
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O P P E 

Of f ice of Priva t e Post- 
secondary Education * 
Ca lifornla State Depart- 
ment of Education. 
Approves Agrees offered 
in California private 
postsecondary institutions 



W A S C 

i 

West e r n_ As soclat ion of 
Schools and Colleges . • 
Vo 1 u n tary, mul ti-s* ate, 
non-governmental agency 
for California, Hawaii, 
Guam, and the Trust 
■Territories, offering 
accreditation, for post- 
secondary institutions 
with one or. wore 
programs exceeding two 
years past high school. 



Comm ission x>n Teacfter 
Credenti al ing"« The 
teacher standards and 
practices agency created 
by the California Legis- 
lature. CTC approves 
and evaluates programs of 
teacher, preparat ion iVi , 
California colleges and 
universities. 



Institutions apply for 
approval to offer a degree 
for the first time, or to 
add degrees. 

The first time degree 
approval process re- 
quires approximately one 
year for completion. 
Institutions wishing to 
add degrees go through an 
amended approval process. 



An institution applies 
to become a Candidate 
for Accreditation and 
has up to 5 yrs. to 
become accredited. 
(Accreditation usually 
takes 6 yrs.pEach year 
a Candidate Institution 
must submit a report * 
update, In California 
the institution must 
have the following; 

1) Approval from the 
State Department of 
Education for eaoh 
degree program. , 

2) A governing board 
which includes 
representation re- 
flecting the public 



CTC rr c A t e 

Nation al* £ouncj 1 for 
Ac c red i t at. ion" o f 
Teache r Education, 
authorized jby the 
Council t>n. Post- 
secondary Accredita- 
tion to adopt 
standards. and procedures 
for accreditation .an<^ 
to determine the 
accreditation Status 
of institutional ^ 

- programs for preparing 

^ " ~ teachers and other 

professional .school 
personnel. 

The evaluation of teacher* Xnstitut ionfc afcply * 
preparation programs in for accreditation . 
California is legislative- af ter *they are fully 
ly mandated. CTC informs operative. ' 1 
institutions when they Ihstitutiohs must give 
will be evaluated, usually evidence that: - 
years after their initial lilts teafcher education 



} 



approval. In order to 
operate an approved CTC 
program, an institution 
must be WASC accredited 
and must submit a docu- 
ment that demonstrates 
compliance with GfC 
standards. 



programs have the 
. approval of the 

appropriate state 
> educational agency.. 

2) It'is Regionally 
accredited. * 

3) It does not dis- 
criminate on the 
basis of rape, creed, 
color* or sex. ' 

4) They have produced 
graduates so their 
performance can. be 
evaluated* 
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Elibibility 
Icont inued)" 



W ft S C 9 

2)(continuecD 
interest, a ^hief 
administrative officer 
-whose major respons- 
ibility is to the' 
institution. 

3 J Faculty , library, 
media equipment, and 
other evidence of basic 
planning. k 

4}A report of elibibil- 
ity. 

SJSubmit $500 and $100 
for each subsequent 
application, or pay 
one time application 



C T C 



oni 
fit 



e of $2 f 000 



Methodology 



Self-study and team. visit* Sel f-p tudy and team visit 

The self-study describes 
the institution's fin- 
ancial stability, 
f aci 1 i ties , f acu 1 ty , 
course of study, and 
degree requirements. 



Self-study shows~how the 
institution demonstrates 
compliance with WASC 
standards. The self- 
study is sent to the 
review team. 



.Program document and 
team visit* 

CTC does not require 
self -study per se. CTC 
does require that the 
I HE present s descrip- 
tion of the program 
currently operating. A 
program document is 
usually used for this 
purpose, it is also 
used for initial 
approva 1 . The docu- 
ment states the 
following: 

1 .That the program is 
in compliance with 
Commission guide- 
lines. 



institutions must 
pay an annual and 
initial membership 
fee. 



Self -study and team 
visit. 

The self-study report 
include* : 

1 -Strengths and 
weaknesses of tfte 
I HE' s teacher 
education program. 

2 .Steps the I HE has 
taken to achieve its 

i institutional and 
programmatic 
objectives. * 

3. Description of^the 
administrative^ staff 
and faculty. *■ 

4. Description of 
policies regarding 
the admission and 



retention of students. 
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Visiting teams consist of 
five members* All 'members 
are selected by the 
Director of OPPE. A maxi- 
mum of 2 ' may b^. selected 
from a Ust of nomina- 
tibns submitted to OPPE % 
by m thq institution to be 
visited. Ail metdbers must 
have expertise in the* 
content area to be 
evaluate* In .alternate 
yeaVs^ the superintendent 
seeks nominations for 
the pool from accredited 
private schools.- Addition- 
\y, names are added to thfe 
pool through informal 
recommendations. 



Size of team Is dependent 
upon size and complexity 
of the institution. 
Constituency is deter- 
mined through consult- 
ation with the institu-, 
tion. The institution 
can accept qr challenge 
for cause team members 
assigned* WASC kc^eps 
pool of names sub** 
ml t ted by Institutional 
Chief ^Administrators- 



2. That courses have 
been assigned to 
meet all of the CTC 
competencies^- 

3. That a plan exists to 
evaluate candidates, 
to conduct a fWlow- . 
up of graduates and 

a, needs analysis. 



5. Description of 

resources it has ' 
available for use 

- in its teacher 
preparation programs. 

6. Its plans for the 
•long-range future of 
its teacher education 
curricula. 



The majority of CTC 

teams are experienced 

* in the credential area 

as practitioners , 

administrators , higher 

educators or laypersons a nee with non-discrimin< 

<having , interest in or atory practices. 

reasons to utilize the A „ *w<» 

services of such creden-° ne third of th€ te * w 
services or sucn creoen A selected {tom 



Usually 8 "competent 
and knowledgeable* 
persons # qua U f led by* 
experience and training 
are selected in accord- 



persons nominated by 
the AACTE* 1/3 from 
NCA nominations, and 
1/3 from personnel 
nominated by other 
constituent and 



tial holders* They are 
selected randomly from 
a pool of interested 
people • 

Teams* vary from 2 to 5 
depending on the com** 
plexity and sizq of the associate members of 
program. Most teams ha veKCATE . Half are from 
3 team members . No higher education, half 
CTC 'team has less than 2 from pr act toners from 
different constituencies various specialty 
repcftented. The majority areas. Institutions 
of the team will have are allowed to veto 
had previous evaluation for cause the appoint- 
or accreditation experiment of ahy tea** 



The > IHBs are given t^e 
names of the ''potential 
team -members and their 
current professional 
^pos i t ion . They are askri 
if there would be a 
potential conflict of 
interest by having any 



member. 



QPPE 

Process Hfc 
Team Composition 

(continued V 
% 

Process m All members go through 

Team training * orientation apd team 

training. 



Guidelines 
Used for the 
Team Visit 



One set of * guide 1 ines if 
used for all degree 
programs reviewed. The 
guidelines are fcentered 
around the following 
areas of study i 

1. Financial stability 

2. Facilities 

3. Facility 

4 . Course of stqdy 

5. Degree requirements 

Eva lua tors are* re- 
quired to rate the 
institution on each 
standard using a five- 
point scale. 

Team members review 
degree programs for 
compliance to OPPE 
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of .these people 'serve 
on a team for their 
programs. 
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Training sessions for 
team members and team 
chairs are held once a 
year. Chair training 
usually lasts 2 days I 
and tegm member train- 
ing usually lasts 1 
day. Also, once they 
are on campus , the 
team members go through 
a half day* orientation 
session. 



' Until 3 year* ago team 
leaded were trained im 
up to 3-day sessions. 
Currently team leaders 
-are trained 2 hours pre** 
ceding the orientation 
of an evaluation visit 
that they are serving as 
team members. All team 
members have an extensive 
orientation session (3 to 
5 hrs.l the niaht before 
,the evaluatiibn visit 
begins on ciyapus,' 



NCATE offers training 
in several locations 
throughout the 
United States. Team 
members must be 
trained. 



Nine major standards 
exists 

1 . Institutional integrity 
2* Purposes 

3 . Governance and Admin- 
istration 

4. Educational programs 

5. Faculty and staff 

6. Library, computer and 
other learning 
resources 

7. Student services and 
student activities t 

8. Physical resources' 
Financial 'resources n 

Team responsibilities 
includes ^_ 
1) Review of instruction- 
al self-study. 



Professional requirements NCATE provides two « 
and field experiences- sets' of standards: 
guidelines are different one set for Basic 
for each program! The Programs and one set 
guidelines** major for Advanced programs 

categories *a re as followstsBotti sets cover the 
1 .Institituionp 1 resources following: 

2. Community resources 1. governance 

3. Admission and field 2. Curricula 
experience requirements 3. Faculty 

4. Professional require- 4,Students f 
ments (competencies) 5 .Resources and 

5\Candidate evaluation, facilities 
v follow-up of graduates 6. Evaluation, program 
needs analysis 



) 

Team visits usually last 
for 3 days. Team members 
review program documents 
and interview faculty. 



review and planning 

visits last. three, 
days. While on campus 
team members must 
develop a schedule 
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standards'. In addition 
the team is. asked to 
indicate how well the 
standards are being met 
and to suggest remedies. 
Specific team responsi- 
bilities include: 

1) Review of the institu- 
tion's sdlf-study. 

2) Two days on campus 're- 
viewing documents and 
interviewing students, 
gradoates , faculty, 
administrators. x * 

No clarification or exit 
interview is held, and 
the team is not present 
wh^n the institution 
hears the team recommend- 
ation. 

An OPPB staff person 
accompanies* the team and 
writes the final report 
based upon the visitation 
team findings. .After the 
report is written, it is 
'sent to. team members for 
their editing and sign- 
off. the superintendent , 
of public instruction 
determines the final 
status* 




C * C 

2) IS d ^Mt^% £^5'" ad^yistrStors, 
vi ewi ^^°^^^^5^K^»^nd ida teS , gr adua tes , 
interviewing ifHf^- -master teacher^, school 
administrators;^^^** administrators, 
student representattVe^employers of graduates, 
nveifibers of the facul t^ya and advisory personnel, 
senate and key faculty 'scheduled by the 
committees, a/id the _ institution prifcr to 
chief administrative the team's arrival on 
officer^ campus. 

3 ) Team evaluates institu- , . 

tio„ fa °<»*»»«iur 0 : sx: 



and objectives 
4) Team writes report of 
findings -organized 
around WASC standards, 
with a description of* 
the ins t i tution • s 
history and progress/ 



interviews, observations, 
{review of materials, and 
a staff monitoring report 
(A staff member monitors 
compliance areas prior to 
the visit:) 



with each aspect of 
CTC guidelines 



are shared with the CAO 
representatives in a 
final meeting on the - c#-*-<**«i-h« 
third day. The institu^ v2i2I2IIL 
tion does not know what J* « t »ff»r-*~ 
the team's recoimiiendatio^^^ 



the 



iveness of meeting 
each requirement. 
5 .Approval recommendation 

The reports are shared 

with faculty represent* 
atives* They are given a 
chance to review t commert 
A WASC s taf f "person is on on the report before the 
campus for the orientatfont*** leaves the campus, 
on the first dayj>nly. Team recommendations and* 

reports go to the Coramis- 
*" sion for an approval 
— — - «- « '—JtekYttyT"""" 



will be. 

6) Team makes confidential 
recommendation to the 
WASC commission. 

7) After the report is 
filed, the Commission 
meet 6 "to consider the 
r ecor.rrenda t ion * 




n c a r t: 

for their visit 
and \h#m interview 
f acul ty, administra- 
tors, students, 
►local school district 
personnel and other 
interested persons. 
Team members pre- 
pare a report 

document) ng. 
1 • Strengths 

2. Weaknesses 

3. Arenas failing to 
meet Ac ATE 
standards 

The chief ^ administra- 
tive officer is * 
given an opportunity 
to comment on the 
written report and 
to file supplemental 
materials f>ertirtent 
*to the facts and 
conclusions irt "tHe * 
team's written re- 
port before HCATE 
takes action on the 
team's report. « 

The team report and 
the institutional 
response are evalu- 
ated by an audit 
committee of HCATE. 
That committee then 
recommends to NCATE 
that tfhe institution* 
teacher education 
program be accredited 
reaccr edited, or 
denied accreditation* 
HCATE hears and acts 
upon the recommenda- 
tion of the audit 
committee. 



t 
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Catc gor ies_ of ftpprova 1 



1 .Approval of* a If , degrees 

2. Approval of any part of 
the degreeg 

3. Denial of all degrees 

4. Denial of any part of 
the degrees 

5. Approval with conditions 
(conditions must be 
minor) 



r 



Terms of Approval Accreditation is valid for 

a maximum of three years 
for approval is. Conditional 
* * approval is valid for the 

remainder of the calendar 
ypar plus on additional 
Calendar year. A staff 
revisit determines 
* * whether or .not the 

condition has been cleared. 



■ + 

\ 
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1. Grant candidacy or 
accreditation 

2 . Extend candidacy or 
reaffirm accreditation 

3 . Candidacy not renewed 
o* accreditation 
terminated 

4 . Warning ~ used when 
WASC discovers 
deviations 

5. Probation - when 
institution fails to 
respond to conditions 

6. Show cause - accredita- 
tion will be terminated 

» unless, response or 

compliance has satisfied 
the HASC Commission 
prior to a specified 
date* 

7 .Denial of application 
S.peferral of application*- 
until certain defic- 
iencies are corrected. 



1 . STANDARD-A 1 1 aspects 

of the program must be 

in compliance and 
' 'found to be effective 

(no conditions) . 
2. PROBATION- Any one or 

more aspect found to be 

out of compliance. 
3„TERMlNATION-Many aspects 

fodnd to be out c$l 

compliance, or / 

ineffective. , m 



1 . Accredltati<£i 

2 . Reacc red i ta t ion 

3. Denial of 
accreditation 



A newly accredited insti- 
tution is revisited 3 yrs. 
after the initial visit, 
fcll accredited institu- 
tions receive an ''Abbrev- 
iated" visit within ten 
years. If, however, the 
Commission hears of 
potential problems at an 
institution or if there 
are major changefe* a 
visit can be scheduled. 



STANDARD - No less than 
five years 

PROBATION - one year, 
then standard or 
termination 



0 



NCATE accreditation 
is effective for a 
period of 7 years. 

In the 5th year; an 
interim accredita- 
tion visit is 
scheduled. If the 
1MB visit is in 
compliance at' that 
time, its accredita- 
tion will be con- 
tinued for another . 
5 yrs. If deficiencies 
are found, the 
institution 1 * viait 
will be scheduled 
at the end of the * 
7th yr. of the 
accreditation cycle. 



if 
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Strengths 

as identified by 

agency representative 



W A S C 



Standards are .written in 
a form that is easy to 
fol low. 



J 



Weaknesses 

as identified 

by agency representative 



The evaluation process is 
subjective and relies on 
volunteers. The abilities 
of the team members vary 
considerably. Teams tend 
to be mostly administr- 
ators because they are 
more able to get away for 
four days in a row. 



C T C 



A staff member Is 
always With the teams 
during the visit to 
ensure that the team 
members understand 
their charge,* to ensure 
that the logistics are 
cared for, and to inter- 
pret guidelines. 

The process Is carried 
out in a very pro- 
fessions t manner. Bad 
programs are easily 
identifiable' through 
this process* but. not 
through the initial 
approval process . 
Therefore, evaluation 
is extremely. valuable 
for the CTC to under- 
stand the programs they 
approve. 



N C A T K 



Accredi tation 
process generally 
uncovers major 
proj^l&ms in ■ , 
programs of pro- 
fessional education. 

Process is carried 
out in a professional 
manner . 



Guidelines are poorly NCATE standards and 
written, and not* obviously their general 
measurable. Team members organization are 
are volunteers so the vague* 

quality of performance 

Jaries! Mo?e extensive *a?erlais are not 
training is needed. sufficient. 
Eyaluation is the biggest Training sessions, 
budget item for the provide only a 

Commission that is funded cursory discussion 
solely out of ^credential of the standards, 
funds. 



O P P E 



Weaknesses 
* as identifies 

-^oy agency representative 
(continued) 
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ERIC 



Team members roust work 
at night to accomplish 
all their tasks. 
Evaluation is ^currently 
on a 6b year cycle and 
many programs have never 
been evaluated by the 
Commission. 

Process needs a stronger 
emphasis on quality* 

-V # 
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